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Abstract. The aim of this note is to connect a reversed form of the Gross log- 
arithmic Sobolev inequality with the Gaussian maximum of Shannon's entropy 
power. There is thus a complete parallel with the well-known link between log- 
arithmic Sobolev inequalities and their information theoretic counterparts. We 
moreover provide an elementary proof of the reversed Gross inequality via a 
two-point inequality and the Central Limit Theorem. 



1. Shannon's entropy power and Gross's inequality 

In the sequel, we denote by Ent^(/) the entropy of a non-negative integrable 
function / with respect to a positive measure ^, defined by 

Ent^(/) := y/log/d/i- Jfd^i log Jfd^i. 

The Shannon entropy ]l5[ | of an rt-variate random vector X with probability density 
function (pdf) / is given by 



U{X) -EntA„ (/) = "// log / dx, 



where dx denotes the n-dimensional Lebesgue measure on R". The Shannon en- 
tropy power fill of X is then given by 

NW:.^expgH(X) 

It is well-known (cf . js) ) that Gaussians saturates this entropy at fixed covari- 
ance. Namely, for any n-variate random vector X with covariance matrix K(X), 
one have 

(1) NiX) < |K(X)|i/", 

and |K|^^" is the entropy power of the n-dimensional Gaussian with covariance K. 

The logarithmic Sobolev inequality of Gross |^ expresses that for any non- 
negative smooth function / : R" R+ 



(2) 2Ent^„(/)<E, 



/ 



where E^„ denotes the expectation with respect to 7„, |-| the Euclidean norm and 
7„ the n-dimensional standard Gaussian given by 

d'-fn{x) := (27r) = g dx. 
Inequality (0) is sharp and the equality is achieved for / of the form exp(a-). 
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By performing a change of function and an optimization, Beckner showed 
(see also Q ) that (^) is equivalent to the following "Euclidean" logarithmic Sobolev 
inequality, for any pdf g 

|2 



(3) EntA„(g)<-log 



2'Ken J g 



'Vlog.g -Vlogg^ gdx, 



where A„ is the n-dimensional Lebesgue measure on R". Therefore, for any n- 
variate random vector X (with pdf g), we have 

(4) N{X)3{X)>n. 

This inequality can be obtained by many methods. The most classical ones are via 
Shannon's entropy power inequality together with DeBruijn identity, or via Stam's 
super-additivity of the Fisher information (cf. 0, Q). Moreover, Dembo 
showed in ||] that (^) is equivalent to 

(5) N(X)|J(X)|i/">l, 

where 3{X) is the Fisher information matrix of X defined by 

JiX) := 1^ 

and we have 3{X) ^ Tr J(X). To deduce (|) from (^, apply (||) to the random 
vector X = K(y) ' Y. Conversely, use the arithmetic-geometric means inequal- 
ity 

(6) (ai---a„)"< 

n 

on the spectrum of the non-negative symmetric matrix 3{X). 

2. Reversed Gross's logarithmic Sobolev inequality 

The Gross logarithmic Sobolev inequality (^ admits a reversed form which states 
that for any positive smooth function / : R" R+ 

(7) %g^<2Ent,„(/). 

Here again, the 2 constant is optimal and the equality is achieved for / of the form 
exp(a-). Alike for (H), one can show by a change of function and an optimization 
that the reverse form (Q) is equivalent to the following inequality, for any pdf g 

TrK(g)- 



Ti 

(8) -Ent;,„(.g) < -log 



27re- 



where K((7) is the covariance matrix of the pdf g. Hence, we have for any n-variate 
random vector X with pdf 

(9, N(X, < 

n 

where K(X) denotes the covariance matrix of X . This inequality is optimal and is 
achieved by Gaussians X . Moreover, as we will show, inequality (|^) is equivalent 
to (0). 

Summarizing, we obtain the following statement 
Theorem 1. The following assertions are true and equivalent 
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(i) For any smooth f : R" R+, 

|E^„(V/)|'<2Ent^„(/)E^„(/). 

(ii) For any smooth g : R" R+, 



-EntA„(g) < I log 



^TrK(,) 

n 



(iii) For any n-variate random vector X with smooth pdf, 

nN{X) < TrK(X) . 

(iv) For any n-variate random vector X with smooth pdf, 

N{X) < |K(X)|^/". 

Therefore, there is a coraplete parallel between the equivalence between (^), (||), 
(H) I @ in one hand and the equivalence between (^ , (^) , (||) , (^ in the other hand. 

3. Sketches of proofs 

In this section, we present first two proofs of (|^), then we explain how to de- 
duce (^ from (|^) and (|l|) from (|^) and vice versa. 

The most natural way to establish (^) is to start from a two-point, inequality, 
just like Gross does for the logarithmic Sobolev inequality (|^) in Namely, if 
we denote by /3 the symmetric Bernoulli measure on {—1,-1-1}, one can show easily 
that for any non- negative function / : {— 1,-|-1} R+, 

(10) (/(+!) - f{-l)r < I Ent^(/) E0(/) . 

This inequality is nothing else but the Csiszar-KuUback inequality for f3 (see ) . 
Actually, the optimal constant for the Bernoulli measure of parameter p = 1 — q is 
p^q^(logq — logp)/{q — p), which resembles the optimal constant for the logarithmic 
Sobolev inequality (see for example 0|), but here again, only the symmetric case 
gives the optimal constant of (|^). 

The next step is to establish the following chain rule formula for Ent, which 
generalizes the classical chain rule formula (cf. |l^, ^) for H 

Proposition 2. For any positive measures fit and their product fi on the product 
space, and for any bounded real valued measurable function f on the product space, 
we have 

n 

(11) Ent^(/)>^Ent^.(E^,,(/)), 

1=1 

where fi\i denotes the product of the measures with j ^ i. 

Finally, inequality (^ can then be recovered by the use of the Central Limit 
Theorem and integration by parts (in both discrete and Gaussian forms). This 
concludes the first proof of (^. 

Actually, inequality (^ can be recovered by a simple semi-group argument, just 
like for the logarithmic Sobolev inequality (||) (cf. |jl^ ) . Namely, consider the heat 
semi-group (P()j>g on R", acting on a bounded continuous function / : R" R 
as follows 

Pt(/)(x) / f{x + Vty)djr,{y). 
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Notice that for any smooth function /, VPt(/) = Pf(V/) and 

ftP,(/) = iAPt(/) = ip*(A/). 

Now, for any smooth positive bounded function / : R" R+, any t > and any 
X, we can write, by performing an integration by parts and omitting the x variable 

Pi(/log/)-Pi(/)logP*(/) = /k[P.(Pt-s(/)logPt-.(/))]ds 

Jo 



Pt-sif) 



ds. 



But by Cauchy-Schwarz inequahty we get 



ivp^-.(/)r 

Pt-sif) 



.(v/)r 



Pt-sif) 



> 



|P.(Pt-.(V/))|^ 

p.(pt-.(/)) 



which gives 



P,(/log/) - P,(/)logP,(/) > 



Finally, inequality follows by taking (i, x) = (1, 0). Notice that this method gives 
also the logarithmic Sobolev inequality (0). Namely, by Cauchy-Schwarz inequality 



\Pt-si^f)\' < P*-s(|V/|)2 < Pt-sif)Pt- 



iv/r 



therefore, we obtain 

Pt(/log/)-P,(/)logP*(/) 



< 



.(v/)r 



Pt-sif) 



Ps Pf 



iv/r 



ds 



ds 



which gives ( |2h by taking here again it, x) — 
To deduce^l) from (0), just apply (0) to 



(1,0). 



fix) = h{x) i2n)^ e— 
where h is a compactly supported smooth pdf. One then gets 

Jxhdx + Jvhdx <2jh\oghdx + J\x f hdx + nlogi2T:). 

But we have pJhdx = 0. Therefore, by denoting K(/i) the covariance matrix 
associated with the pdf h, one gets 

1 n 
-EntA,.(/i) < -TrK(/i) + -log(2^), 

which remains true for any smooth pdf h. Finally, by performing the change of 
function h = agia-) and optimizing in a, one obtains 
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-EntA„ (/i) < - log 27re — 

which is nothing else than (^) . Conversely, it is easy to see that we can recover (|^) 
for any pdf / by approximating / by compactly supported probability density 
functions. 

The equivalence between (|^) and (Ej) is obtained as for the equivalence be- 
tween (H) and (H) . Namely, to deduce (P from , apply ^ to the random vector 

X = K(Y)~^^^Y. Conversely, use the arithmetic-geometric means inequality (||) 
on the spectrum of the non-negative symmetric matrix K(X). 

4. Remarks 

It is well-know that the logarithmic Sobolev inequality (H) is a consequence of 
the Gaussian isoperimetric inequality [p^ . In contrast, it is shown in |^ that the 
reversed form (Q) is equivalent to a translation property |^ . Namely, for any smooth 
function / : R" ^ [0, 1] 

(12) |E^„(V/)| <I(E^„(/)), 

where I is the Gaussian isoperimetric function given by I $' o <I>^^, where $ is 
the Gaussian distribution function given by $(•) :— 7((— oo, •]). Bobkov's inequal- 
ity (|l2|) expresses that among all measurable sets with fixed Gaussian measure, half 
spaces have minimum barycenter Q. 
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